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FOREWORD 


The Software Engineering Laboratory (SEL) is an organization sponsored by the Na- 
tional Aeronautics and Space Administration/Goddard Space Flight Center (NASA/ 
GSFC) and created for the purpose of investigating the effectiveness of software 
engineering technologies when applied to the development of applications software. 
The SEL was created in 1976 and has three primary organizational members: 

NASA/GSFC, Systems Development Branch 

The University of Maryland, Computer Science Department 

Computer Sciences Corporation, Systems Development Operation 

The goals of the SEL are (1) to understand the software development process in the 
GSFC environment; (2) to measure the effects of various methodologies, tools, and 
models on this process; and (3) to identify and then to apply successful development 
practices. The activities, findings, and recommendations of the SEL are recorded in 
the Software Engineering Laboratory Series, a continuing series of reports that in- 
cludes this document. 

The major contributors to this document are 

William Decker (CSC) 

Robert Hendrick (CSC) 

Jon Valett (GSFC) 

Single copies of this document can be obtained by writing to 

Systems Development Branch 
Code 552 

Goddard Space Flight Center 
Greenbelt, Maryland 20771 
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ABSTRACT 



£1 
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Ihis=document-captures over 50 individual SEL research results, extracted from a re- 
view of published SEL documentation, that can be applied directly to managing soft- 
ware development projects/ Four basic categories of results are defined and 
discussed— environmenfprofiles, relationships, models, and management rules. In 
each category, research results are presented as a single page that summarizes the indi- 
vidual result, lists potential uses of the result by managers, and references the original 
SEL documentation where the result was found. The document serves as a concise 
reference summary of applicable research for SEL managers. 
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SECTION 1 - INTRODUCTION 


The Software Engineering Laboratory (SEL) was established in 1977 to support 
research in the measurement and evaluation of the software development process 
(Reference 1). The SEL is a cooperative effort of the National Aeronautics and Space 
Administration/Goddard Space Flight Center (NASA/GSFC), Computer Sciences 
Corporation (CSC), and the University of Maryland. Under its sponsorship, numer- 
ous experiments have been designed and executed to study the effects of applying vari- 
ous tools, methodologies, and models to the software development efforts in flight 
dynamics applications. 

The SEL has been researching and evaluating software development methodologies 
for over 13 years. This research has provided valuable insight into the software devel- 
opment process of one particular organization. By collecting detailed software devel- 
opment data and recording that data in a software engineering data base (References 2 
and 3), the SEL has been able to characterize and understand the development proc- 
ess within that organization. Many of the research results that have been published by 
the SEL over the years can be applied directly to managing software development 
projects in the SEL environment. 

To help promote successful software development practices in this environment, the 
SEL recognized the potential of providing the experience of previous projects— the 
data, research results, and knowledge of experienced software managers— to the man- 
agers of ongoing projects. Research efforts were undertaken to determine if and how 
SEL experience and data could be effectively incorporated into an automated tool to 
provide insight into a project. Reference 4 describes an experimental, automated tool, 
the Software Management Environment (SME), currently in development. 

As part of the tool development, the SEL conducted a thorough review of published 
SEL research. This review revealed several categories of data and findings that are 
fundamental to the construction and use of a tool to support the management of soft- 
ware development projects. These results are also useful to managers outside of an 
automated tool; in fact, many of the results are simply formal presentations of data 
used by managers on a regular basis. 

This document contains a representative set of the research results extracted during 
the review of SEL documentation that can be used by software development manag- 
ers. As a result, the document can serve as a concise reference summary of applicable 
research for SEL managers. (Each research result lists one of the source documents. 
References 5 through 14, where additional detailed information may be found.) 

Although this research applies to projects within the SEL, other organizations may use 
the results as a starting point in their efforts to understand their own environments. 
The results provide a fundamental set of knowledge that illustrates the types of data an 
organization should assemble and suggests how to use the data. 
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The remainder of this document describes SEL research results organized by section 
into four basic categories: environment profiles, relationships, models, and manage- 
ment rules. Section 2 describes profiles containing typical values that characterize 
software development projects in the SEL environment. Section 3 describes relation- 
ships between various software development measures that are essential to successful 
planning and estimation activities. Section 4 describes models that capture the 
expected behavior of software development measures over the course of the develop- 
ment life cycle. Section 5 describes management rules that can help in diagnosing 
problems and evaluating the status of software development projects. 

Each section first defines and describes the result type and then presents a series of 
representative samples of the result type. The results appear as single-page displays 
that include the following information: the result type, a text description of the result, 
a list of management activities to which the result can be applied, the SEL document 
reference, and a tabular and/or graphic representation of the result. 

Thble 1-1 presents a complete list of all single-page results presented in the document 
by title with the page number of the result. Table 1-2 contains a cross-reference of the 
research results grouped by specific factors of interest to managers. Note that individ- 
ual results may appear several times in the list if the result relates to more than one 
factor. 
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Table 1-1. Index of Results (1 of 2) 


NUMBER 

— TTTLE'OF RESULT 

PAGE 

Result 2-1 

PROCESS AND PRODUCT CHARACTERISTICS 

2-2 

Result 2-2 

PERFORMANCE AND QUALITY CHARACTERISTICS 

2-3 

Result 2-3 

EFFORT DISTRIBUTION BY STAFF CATEGORY 

2-4 

Result 2-4 

EFFORT DISTRIBUTION BY ACTIVITY 

2-5 

Result 2-5’ 

ERROR' DISTRIBUTION BY ERROR CLASS 

2-6 

Result 2-6 

ERROR DISTRIBUTION BY EFFORT TO CORRECT 

2-7 

Result 2-7 

PAGE DISTRIBUTION BY DOCUMENT TYPE 

2-8 

Result 2-8 

COST OF USER DOCUMENTATION 

2-9 

Result 2-9 

COST OF REUSE 

2-10 

Result 3-1 

EFFORT VS. UNES OF CODE 

3-3 

Result 3-2 

EFFORT VS. MODULES 

3-4 

Result 3-3 

DURATION VS. UNES OF CODE 

3-5 

Result 3-4 

DURATION VS. MODULES 

3-6 

Result 3-5 

DURATION VS. EFFORT 

3-7 

Result 3-6 

STAFF SIZE VS. EFFORT 

3-8 

Result 3-7 

PRODUCTIVITY VS. CODE REUSE 

3-9 

Result 3-8 

PRODUCTIVITY VS. MODULE REUSE . 

3-10 

Result 3-9 

COMPUTER RUNS VS. UNES OF CODE 

3-11 

Result 3-10 

COMPUTER RUNS VS. EFFORT 

3-12 

Result 3-1 1 

COMPUTER TIME VS. LINES OF CODE 

3-13 

Result 3-12 

DOCUMENTATION PAGES VS. UNES OF CODE 

3-14 

Result 3-13 

DOCUMENTATION PAGES VS. MODULES 

3-15 

Result 3-14 

DOCUMENTATION PAGES VS. EFFORT 

3-16 

Result 3-15 

SIZE. EFFORT. AND SCHEDULE BY PHASE 

3-17 

Result 3-16 

EFFORT ADJUSTMENT FOR COMPLEXITY 

3-18 

Result 3-17 

EFFORT ADJUSTMENT FOR TEAM EXPERIENCE 

3-19 

Result 3-18 

EFFORT ADJUSTMENT FOR SCHEDULE TYPE 

3-20 

Result 4-1 

SCHEDULE BY PHASE 

4-3 

Result 4-2 

EFFORT BY PHASE 

4-4 

Result 4-3 

EFFORT ACTIVITY BY PHASE 

4-5 

Result 4-4 

UNES OF CODE BY PHASE 

4-6 

Result 4-5 

COMPUTER USE BY PHASE 

4-7 

Result 4-6 

ERROR RATE IN EACH PHASE 

4-8 

Result 4-7 

PROGRAMMER HOURS PER LINE OF CODE BY PHASE 

4-9 

Result 4-8 

COMPUTER RUNS PER LINE OF CODE BY PHASE 

4-10 

Result 4-9 

SOFTWARE CHANGES PER UNE OF CODE BY PHASE 

4-11 

Result 4-10 

COMPUTER TIME PER LINE OF CODE BY PHASE 

4-12 

Result 4-11 

PROGRAMMER HOURS PER COMPUTER RUN BY PHASE 

4-13 

Result 4-12 

SOFTWARE CHANGES PER COMPUTER RUN BY PHASE 

4-14 

Result 4-13 

COMPUTER TIME PER COMPUTER RUN BY PHASE 

4-15 

Result 4-14 

PROGRAMMER HOURS PER SOFTWARE CHANGE BY PHASE 

4-16 

Result 4-15 

COMPUTER TIME PER SOFTWARE CHANGE BY PHASE 

4-17 

Result 4-16 

UNCERTAINTY IN EFFORT AND SIZE ESTIMATES BY PHASE 

4-18 

Result 4-17 

TRENDS IN EFFORT TO CHANGE BY PHASE 

4-19 

Result 4-18 

TRENDS IN CHANGES PER COMPUTER RUN BY PHASE 

4-20 

Result 4-19 

TRENDS IN COMPUTER TIME PER CHANGE BY PHASE 

4-21 
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Table 1 -1 . Index of Results (2 of 2) 


NUMBER 

TITLE OF RESULT 

PAGE 

Result 5-1 

VARIATIONS IN EFFORT TO CHANGE 

53 

Result 5-2 

DEVIATIONS IN STAFFING PLAN 

54 

Result 5-3 

VARIATIONS IN SIZE AND EFFORT ESTIMATES 

55 

Result 5-4 

HIGH COMPUTER USE 

56 

Result 5-5 

DEVIATIONS IN COMPUTER USE PER LINE OF CODE 

57 

Result 5-6 

DEVIATIONS IN UNES OF CODE 

58 

Result 5-7 

DEVIATIONS IN CHANGES PER LINE OF CODE 

59 

Result 5-8 

DEVIATIONS IN UNES OF CODE PER STAFF HOUR 

510 




Table 1-2. Research Results Grouped by Factor (1 of 3) 


FACTOR 

TYPE OF RESULT 

DESCRIPTION OF RESEARCH RESULT 

RESULT 

NUMBER 

Changes 

Profile 

CHANGE RATE DURING IMPLEMENTATION 

Result 2-2 


Model 

SOFTWARE CHANGES PER LINE OF CODE BY PHASE 

Result 4-9 


Model 

SOFTWARE CHANGES PER COMPUTER RUN BY PHASE 

Result 4-12 


Model 

PROGRAMMER HOURS PER SOFTWARE CHANGE BY PHASE 

Result 4-14 


Model 

COMPUTER TIME PER SOFTWARE CHANGE BY PHASE 

Result 4-15 


Model 

TRENDS IN EFFORT TO CHANGE BY PHASE 

Result 4-17 


Model 

TRENDS IN CHANGES PER COMPUTER RUN BY PHASE 

Result 4-18 


Model 

TRENDS IN COMPUTER TIME PER CHANGE BY PHASE 

Result 4-19 


Management Rule 

DEVIATIONS IN CHANGES PER LINE OF CODE 

Result 5-7 

Computer Runs 

Relationship 

COMPUTER RUNS VS. UNES OF CODE 

Result 3-9 


Relationship 

COMPUTER RUNS VS. EFFORT 

Result 3-10 


Model 

COMPUTER RUNS PER LINE OF CODE BY PHASE 

Result 4-8 


Model 

PROGRAMMER HOURS PER COMPUTER RUN BY PHASE 

Result 4-1 1 


Model 

SOFTWARE CHANGES PER COMPUTER RUN BY PHASE 

Result 4-12 


Model 

COMPUTER TIME PER COMPUTER RUN BY PHASE 

Result 4-13 


Model 

TRENDS IN CHANGES PER COMPUTER RUN BY PHASE 

Result 4-18 


Management Rule 

VARIATIONS IN EFFORT TO CHANGE 

Result 5-1 

Computer Time 

Relationship 

COMPUTER TIME VS. UNES OF CODE 

Result 3-1 1 


Model 

COMPUTER USE BY PHASE 

Result 4-5 


Model 

COMPUTER TIME PER UNE OF CODE BY PHASE 

Result 4-10 


Model 

COMPUTER TIME PER COMPUTER RUN BY PHASE 

Result 4-13 


Model 

COMPUTER TIME PER SOFTWARE CHANGE BY PHASE 

Result 4-15 


Model 

TRENDS IN COMPUTER TIME PER CHANGE BY PHASE 

Result 4-19 


Management Rule 

HIGH COMPUTER USE 

Result 5-4 


Management Rule 

DEVIATIONS IN COMPUTER USE PER LINE OF CODE 

Result 5-5 

Documentation 

Profile 

PAGE DISTRIBUTION BY DOCUMENT TYPE 

Result 2-7 


Profile 

COST OF USER DOCUMENTATION 

Result 2-8 


Relationship 

DOCUMENTATION PAGES VS. UNES OF CODE 

Result 3-12 


Relationship 

DOCUMENTATION PAGES VS. MODULES 

Result 3-13 


Relationship 

DOCUMENTATION PAGES VS. EFFORT 

Result 3-14 

Duration 

Profile 

AVERAGE PROJECT DURATION 

Result 2-1 


Relationship 

DURATION VS. UNES OF CODE 

Result 3-3 


Relationship 

DURATION VS. MODULES 

Result 3-4 


Relationship 

DURATION VS. EFFORT 

Result 3-5 


Relationship 

SIZE, EFFORT, AND SCHEDULE BY PHASE 

Result 3-15 

Effort 

Profile 

AVERAGE PROJECT EFFORT 

Result 2-1 


Profile 

EFFORT DISTRIBUTION BY STAFF CATEGORY 

Result 2-3 


Profile 

EFFORT DISTRIBUTION BY ACTIVITY 

Result 2-4 


Profile 

ERROR DISTRIBUTION BY EFFORT TO CORRECT 

Result 2-6 


Relationship 

EFFORT VS. UNES OF CODE 

Result 3-1 


Relationship 

EFFORT VS. MODULES 

Result 3-2 


Relationship 

DURATION VS. EFFORT 

Result 3-5 


Relationship 

STAFF SIZE VS. EFFORT 

Result 3-6 


Relationship 

COMPUTER RUNS VS. EFFORT 

Result 3-10 


Relationship 

DOCUMENTATION PAGES VS. EFFORT 

Result 3-14 


Relationship 

SIZE. EFFORT. AND SCHEDULE BY PHASE 

Result 3-15 
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Table 1-2. Research Results Grouped by Factor (2 of 3) 


FACTOR ' 

TYPE OF RESULT 

DESCRIPTION OF RESEARCH RESULT 

RESULT 

NUMBER 

Effort (Cont'd) 

Relationship 

EFFORT ADJUSTMENT FOR COMPLEXITY 

Result 3-16 


Relationship 

EFFORT ADJUSTMENT FOR TEAM EXPERIENCE 

Result 3-17 


Relationship 

EFFORT ADJUSTMENT FOR SCHEDULE TYPE 

Result 3-18 


Model 

EFFORT BY PHASE 

Result 4-2 


Model 

EFFORT ACTIVITY BY PHASE 

Result 4-3 


Model 

PROGRAMMER HOURS PER LINE OF CODE BY PHASE 

Result 4-7 


Model 

PROGRAMMER HOURS PER COMPUTER RUN BY PHASE 

Result 4-1 1 


Model 

PROGRAMMER HOURS PER SOFTWARE CHANGE BY PHASE 

Result 4-14 


Model 

UNCERTAINTY IN EFFORT AND SIZE ESTIMATES BY PHASE 

Result 4-16 


Model 

TRENDS IN EFFORT TO CHANGE BY PHASE 

Result 4-17 


Management Rule 

VARIATIONS IN EFFORT TO CHANGE 

Result 5-1 . 


Management Rule 

VARIATIONS IN SIZE AND EFFORT ESTIMATES 

Result 5-3 


Management Rule 

DEVIATIONS IN LINES OF CODE PER STAFF HOUR 

Result 5-8 

Errors 

Profile 

ERROR RATE DURING IMPLEMENTATION 

Result 2-2 


Profile 

ERROR RATE DURING SYSTEM TESTING 

Result 2-2 


Profile 

ERROR RATE DURING ACCEPTANCE TESTING 

Result 2-2 


Profile 

ERROR RATE DURING MAINTENANCE/OPERATIONS 

Result 2-2 


Profile 

ERROR DISTRIBUTION BY ERROR CLASS 

Result 2-5 


Profile 

ERROR DISTRIBUTION BY EFFORT TO CORRECT 

Result 2-6 


Model 

ERROR RATE IN EACH PHASE 

Result 4-6 

Experience 

Profile 

AVERAGE APPLICATION EXPERIENCE OF MANAGERS 

Result 2-1 


Profile 

AVERAGE OVERALL EXPERIENCE OF MANAGERS 

Result 2-1 


Profile 

AVERAGE APPLICATION EXPERIENCE OF TECHNICAL STAFF 

Result 2-1 


Profile 

AVERAGE OVERALL EXPERIENCE OF TECHNICAL STAFF 

Result 2-1 


Relationship 

EFFORT ADJUSTMENT FOR TEAM EXPERIENCE 

Result 3-17 

Process 

Profile 

AVERAGE CODING RATE 

Result 2-2 


Profile 

NOMINAL MAINTAINABILITY INDICATORS 

Result 2-2 


Profile 

NOMINAL RELIABILITY INDICATORS 

Result 2-2 


Relationship 

PRODUCTIVITY VS. CODE REUSE 

Result 3-7 


Relationship 

PRODUCTIVITY VS. MODULE REUSE 

Result 3-8 

Product Size 

Profile 

AVERAGE LINES OF CODE DELIVERED 

Result 2-1 


Relationship 

EFFORT VS. LINES OF CODE 

Result 3-1 


Relationship 

EFFORT VS. MODULES 

Result 3-2 


Relationship 

DURATION VS. LINES OF CODE 

Result 3-3 


Relationship 

DURATION VS. MODULES 

Result 3-4 


Relationship 

COMPUTER RUNS VS. LINES OF CODE 

Result 3-9 


Relationship 

COMPUTER TIME VS. LINES OF CODE 

Result 3-1 1 


Relationship 

DOCUMENTATION PAGES VS. LINES OF CODE 

Result 3-12 


Relationship 

DOCUMENTATION PAGES VS. MODULES 

Result 3-13 


Relationship 

SIZE, EFFORT AND SCHEDULE BY PHASE 

Result 3-15 


Model 

LINES OF CODE BY PHASE 

Result 4-4 


Model 

PROGRAMMER HOURS PER LINE OF CODE BY PHASE 

Result 4-7 


Model 

COMPUTER RUNS PER LINE OF CODE BY PHASE 

Result 4-8 


Model 

SOFTWARE CHANGES PER LINE OF CODE BY PHASE 

Result 4-9 


Model 

COMPUTER TIME PER LINE OF CODE BY PHASE 

Result 4-10 


Model 

UNCERTAINTY IN EFFORT AND SIZE ESTIMATES BY PHASE 

Result 4-16 
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Table 1-2. Research Results Grouped by Factor (3 of 3) 


FACTOR 

TYPE OF RESULT 

DESCRIPTION OF RESEARCH RESULT 

RESULT 

NUMBER 

Product Size 

Management Rule 

VARIATIONS IN SIZE AND EFFORT ESTIMATES 

Result 5-3 

(Cont'd) 

Management Rule 

DEVIATIONS IN COMPUTER USE PER UNE OF CODE 

Result 5-5 


Management Rule 

DEVIATIONS IN UNES OF CODE 

Result 5-6 


Management Rule 

DEVIATIONS IN CHANGES PER UNE OF CODE 

Result 5-7 


Management Rule 

DEVIATIONS IN LINES OF CODE PER STAFF HOUR 

Result 5-8 

Reuse 

Profile 

AVERAGE REUSE PERCENTAGE 

Result 2-2 


Profile 

COST OF REUSE 

Result 2-9 


Relationship 

PRODUCTIVITY VS. CODE REUSE 

Result 3-7 


Relationship 

PRODUCTIVITY VS. MODULE REUSE 

Result 3-8 

Schedule 

Relationship 

EFFORT ADJUSTMENT FOR SCHEDULE TYPE 

Result 3-18 


Model 

SCHEDULE BY PHASE 

Result 4-1 

Staffing 

Profile 

AVERAGE STAFF SIZE (FTE) 

Result 2-1 


Profile 

PEAK STAFF SIZE 

Result 2-1 


Profile 

TOTAL STAFF SIZE (INDIVIDUALS) 

Result 2-1 


Profile 

EFFORT DISTRIBUTION BY STAFF CATEGORY 

Result 2-3 


Relationship 

STAFF SIZE VS. EFFORT 

Result 3-6 


Management Rule 

DEVIATIONS IN STAFFING PLAN 

Result 5-2 
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SECTION 2 -ENVIRONMENT PROFILES 


The term “environment profile” refers to a SEL research result containing typical val- 
ues that characterize software development in the SEL environment. These profiles 
describe what constitutes a normal project under typical conditions. They include a 
wide range of factors relevant to this environment and serve as a basis for better under- 
standing the SEL development process. 

The projects studied by the SEL generally involve the development of scientific, 
ground-based, interactive graphics software with moderate reliability and response re- 
quirements. Representative applications provide spacecraft support in the areas of 
attitude determination, attitude control, maneuver planning, orbit adjustment, and 
mission analysis. 

An environment profile captures values that characterize one or more relevant aspects 
of the development process in the SEL environment. These profiles serve as a basic 
piece of management data by providing a standard for managers to use in evaluating 
and planning new projects. Managers also use profiles as a baseline for assessing the 
effects of improvement initiatives. 

The following paragraphs describe three groups of environment profiles identified 
through SEL research efforts. 

• Characteristic values describe nominal SEL values related to product, 
process, performance, and quality factors. These profiles provide a standard 
for determining if a project is representative of the environment with respect 
to overall project-specific features such as effort, size, duration, or staffing 
levels. They additionally provide a means for evaluating a project’s per- 
formance and quality with regard to factors such as productivity, reliability, 
and maintainability. 

• Distribution profiles describe the typical allocation of a key software devel- 
opment measure or resource classified according to its type. Examples of 
these profiles include distributions for effort by reported activity and for er- 
rors by effort to correct. 

• Cost profiles describe heuristics that express typical values for costs that may 
reduce or increase normal expenditures from the basic development costs. 
Examples of these profiles include the cost of reuse and cost of user docu- 
mentation. 

The following pages present a selection of representative environment profiles pub- 
lished by the SEL. 
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PERFORMANCE AND QUALITY CHARACTERISTICS Result 2-2 
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EFFORT DISTRIBUTION BY STAFF CATEGORY Result 2-3 
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Programmers ( 84 . 0 %) 







ERROR DISTRIBUTION BV ERROR CLASS Result 2-5 
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PAGE DISTRIBUTION BY DOCUMENT TYPE Result 2-7 
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User Documents (4 









COST OF USER DOCUMENTATION Result 2-8 
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jllWj Basic Development Additional Cost 
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Extent of Modifications or Additions Needed 














SECTION 3 -RELATIONSHIPS 


The term “relationship” refers to a SEL research result that describes the correlation 
between various software development measures at a specific point in the project life 
cycle. These relationships provide a method for projecting the values of unknown de- 
velopment measures and costs from information that is more readily available or more 
accurately known. 

Extensive SEL research has been conducted to identify key software development 
measures in this environment and to quantify the relationships that exist between 
these measures. Since accurate estimation and planning are essential in successfully 
managing the development process, many SEL studies focus on estimating project 
completion values such as total effort, product size, and expected duration. These 
studies generally apply statistical analysis to historical project data to obtain useful re- 
lationships. 

Managers employ these results to facilitate and standardize the planning and estima- 
tion process. Without a set of relationships derived from an understanding of the envi- 
ronment and from historical data, planning and estimation become largely guesswork. 
As a result, relationships between key development measures or costs are considered 
basic and necessary management data. 

The following paragraphs describe three distinct groups of relationships identified 
through SEL research efforts. 

• General relationship s are time-independent equations that describe the 
correlation between key software development measures at project comple- 
tion. These relationships provide a method for projecting a desired value 
based on the known or estimated values of other measures. For example, an 
equation that expresses total staff-hours as a function of lines of code (LOC) 
may be used to estimate the effort required for a project of a given size. 

When planning a project, experienced managers (or estimators) follow an 
established procedure that employs these relationships. Generally, this pro- 
cess involves (1) estimating the size of the software product, (2) converting 
the size estimate to an estimate of total effort, and (3) determining an ex- 
pected duration and practical staffing level for completing the project. 

Since a set of relationships should be inherently consistent for the environ- 
ment, a manager’s use of relationships in this process implicitly detects and 
helps correct potential planning problems. For example, a relationship that 
expresses duration as a function of LOC may identify the impracticality of 
targeting the software delivery for a specified date without a reduction in 
scope or size. 
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• Phase-dependent relationships are time-independent equations, typically 
captured as a set of equations in a table, that apply to specific life-cycle 
phases during the project. They provide a method of reestimating the com- 
pletion values of key software development measures for ongoing projects 
based on the most accurate and latest information available. 

As prescribed in the SEL environment, managers reestimate the values for 
key development measures at the end of each life-cycle phase. The basic 
values to be reestimated consist of effort, schedule duration, and project 
size. SEL research has identified an optimum set of relationships for each 
phase to accomplish this reestimation. 

These relationships comprise a system intended for use with specific data 
that are available when the relevant phase completes. For example, the 
most accurate measure of project size available through the requirements 
analysis phase may be the number of subsystems. After detailed design, 
when the system has been decomposed to a finer level, the most accurate 
measure of project size may be the number of modules. The discrete sets of 
relationships reflect the increasing granularity and decreasing uncertainty 
that occurs as the life-cycle progresses. 

• Adjustment factors describe relationships expressing guidelines for deter- 
mining multiplicative factors that may be applied to refine estimates. These 
factors account for differences in the problem, process, or environment that 
vary significantly from typical development conditions and that will increase 
or decrease nominal project expenditures. 

These relationships are represented in a tabular format that can be used to 
calculate the appropriate adjustment factor when atypical conditions arise. 
Estimates from other relationships, derived for nominal projects, are multi- 
plied by the computed factor to revise the estimate upward or downward as 
needed. 

Examples of these relationships include guidelines for adjusting effort esti- 
mates to reflect problem complexity or development team experience. 

The following pages present a selection of representative relationships published by 

the SEL. 
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Describes an alternative relationship, 0 = 4.836 * DL 0257 , that relates duration to 
source lines ot code in developed KSLOC. 
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number ot developed modules. 
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Effort (Staff -months) 
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Effort (Staff -months) 








PRODUCTtVITY vs. CODE REUSE Result 3-7 
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0.4 0.5 0.6 07 

Developed/Delivered LOC 









PRODUCTIVITY vs. MODULE REUSE Result 3-8 
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0.2 03 04 OS 06 07 OB 

Developed/Delivered Modules 














COMPUTER RUNS vs. EFFORT Result 3-10 
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Article also appears in Proceedings of the Ninth International Computer Software and 
Applications Conference, October 1985. 
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Describes an alternative relationship, P = 0.04 * L, that relates pages of documenta- 
tion to source lines of code in developed SLOC. 







DOCUMENTATION PAGES vs. MODULES Result 3-13 
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Describes an alternative relationship, DOC = 359.300 * DM 0 279 , that relates pages 
o( documentation to the total number ot developed modules. 








DOCUMENTATION PAGES vs. EFFORT Result 3-14 
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Applications Conference, October 1985. 










3-17 


6199 


is schedule expended in calendar weeks through the current phase 
















EFFORT ADJUSTMENT FOR SCHEDULE TYPE Result 3-18 
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experience with the application area; Environment Type is OLD when the 
development team has more than 2 years experience with the computing 
environment.) 












SECTION 4 -MODELS 


The term “model” refers to a SEL research result that describes the expected behavior 
of a software development measure as a function of time. For example, a research 
result containing a tabular listing of the fraction of errors detected during each devel- 
opment phase can be considered a “model of error detection.” This type of research 
result has been described and applied in many SEL studies. 

SEL research studies employ models to represent a “typical” project. The study results 
are commonly based on analyzing the comparison of some project of interest to the 
model. In almost all cases, the models have been obtained by averaging the behavior 
of the measure over several projects. 

A model is a basic piece of management data. Models provide the standard or guide- 
lines that managers use to judge the status of a project. By comparing the evolution of 
a measure to its expected behavior, the manager can assess a project’s health and pre- 
dict the measure’s future behavior. Models of resource measures, such as effort or 
computer use, also can be used for planning. 

The following paragraphs describe five groups of models. 

• A schedule model describes how much time is allocated to each phase of the 
software development life cycle. In the SEL environment, most research re- 
sults are obtained from projects in the requirements analysis through accep- 
tance testing life-cycle phases. 

A schedule model is combined with each of the other types of models to pro- 
vide a time scale for depicting the “typical” project in the environment. 

• A basic measure model describes the behavior over time of a fundamental 
software development measure such as LOC, effort, or software errors. 

A manager uses basic measure models for tracking those software develop- 
ment measures that are directly related to the magnitude of the specific 
project being monitored. An estimate of the completion value of the meas- 
ure for the project (see Section 3) is required since each model expresses a 
measure’s behavior on a normalized scale. 

• An environment model describes the behavior over time of a ratio of two 
basic software development measures such as computer resource usage per 
job, LOC per staff hour, or errors per LOC. 

Environment models are useful when a manager tracks a project’s behavior 
as it compares to other projects in the environment. The effects of project 
size are minimized through the use of ratios. These models are characteris- 
tic of the environment and not a single project; therefore, they are not nor- 
malized but are expressed in absolute units. 
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• An uncertainty model describes the changing confidence interval for re- 
source estimates over time. As a software development project evolves 
through specification, design, and implementation, more information be- 
comes available about the eventual size of the completed project. As the 
project evolves, the manager’s estimates of the resources required to com- 
plete it become more certain. The model describes the manner in which the 
uncertainty decreases. 

• A subjective model is a description of specific features of a software develop- 
ment measure’s probable behavior over time. The development measures 
are either basic measures or ratios of basic measures. SEL research de- 
scribes these models with text and in some cases they are illustrated by a 
sketch. Subjective models are based on the experiences of managers in a 
particular software development environment. Subjective models are not 
quantitative; they describe the characteristics of a measure’s behavior using 
words such as “constant,” “increasing,” or “starts to decrease.” 

Subjective models describe significant features of the behavior of measures 
that signal to the manager when a development process is working correctly 
or incorrectly. In SEL literature, subjective models are often paired with 
rules that indicate problems. For example, a subjective model that describes 
a measure’s behavior as “constant in magnitude” is another view of a rule 
that states that a rapidly changing measure is an indicator of a problem. 

The following pages describe a selection of models published by the SEL. 


4-2 


6199 




4-3 


6199 


R«qoi»«m#n<» Ane>y ><s D*leJ*d Design System Testing 

* Preliminary Design Implementation Acceptance Testing 












4-4 


6199 


Requnem#r«» An»V»i» 6eteil*d Design System Testing 

Piefiminery Design Implement ation Accept ence Testing 



































6199 




































COMPUTER RUNS PER LINE OF CODE BY PHASE Result 4-8 
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SOFTWARE CHANGES PER LINE OF CODE BY PHASE Result 4-9 



4-11 


6199 












COMPUTER TIME PER LINE OF CODE BY PHASE Result 4-10 
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COMPUTER TIME PER COMPUTER RUN BY PHASE Result 4-13 
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PROGRAMMER HOURS PER SOFTWARE CHANGE BY PHASE Result 4-14 
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COMPUTER TIME PER SOFTWARE CHANGE BY PHASE Result 4-15 



4-17 


6199 











4-18 


6199 


R*qu«*m*rtfs An*V*fo D«ta3»d Design - System T»»tlng 

End of Life-Cycle Phase 














TRENDS IN EFFORT TO CHANGE BY PHASE '.! Result 4-17 
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Report originally prepared as a University ot Maryland Technical Memorandum dated . 
December 1982. 








TRENDS IN CHANGES PER COMPUTER RUN BY PHASE Result 4-18 
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Report originally prepared as a University of Maryland Technical Memorandum dated 
December 1982. 












TRENDS IN COMPUTER TIME PER CHANGE BY PHASE Result 4-19 
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Report originally prepared as a University of Maryland Technical Memorandum dated 
December 1982. 








SECTION 5 -MANAGEMENT RULES 


The term “management rule” refers to a SEL research result that specifies how to in- 
terpret the observed behavior of a software development measure. These rules are 
formal statements typically used in evaluating data collected during ongoing develop- 
ment efforts. Rules can stand alone or can be combined to work together to give more 
detailed conclusions. 

Automating the use of management rules is a recent area of interest in the SEL, al- 
though many of the rules listed here were recorded in early SEL research. Managers 
have always applied informal rules to the process of assessing a project’s status. 

The following paragraphs describe three groups of rules. 

• Independent rules stand alone and are applicable to a single specific situa- 
tion. An observation is interpreted with no mention of when the observation 
is made during the life cycle nor is the measure compared to a model to aid 
in drawing the conclusion. 

Independent rules are typical of what managers think of as “rules of thumb” 
or “project management lore.” They usually state something about the 
overall status of the project. 

• Model-dependent rules require a standard, or model, to which a measure is 
first compared. Based on the comparison and an observed deviation from 
the standard, an interpretation is presented. This type of rule was implied by 
the “assessment” applications described for models in Section 4. This type 
of rule requires both a model of the measure and possibly an estimate of the 
completion value for the measure. 

During the life of a project, a manager charts software development data to 
monitor progress. By comparing the actual progress to a model, the manag- 
er can spot deviations earlier. Model-dependent rules describe the conse- 
quences of a particular deviation based on observations of previous 
projects. 

• Phase-dependent rules are model-dependent rules that are made more 
elaborate by introducing the life-cycle phase into the rule. This allows dif- 
ferent conclusions to be drawn based on the time at which the measure de- 
viated from the standard. 

Sets of rules (independent, model-dependent, and/or phase-dependent) can be 
created to provide more depth on which to draw conclusions. While each rule will 
probably not result in the same conclusion, the advantage of a set of rules comes from 
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“voting” the conclusions. The one conclusion that is most prevalent (or better yet, in 
the majority) has a good likelihood of being appropriate to the project’s situation. 
This is similar to managers “taking everything into account.” 

The following pages describe a selection of rules published by the SEL. 
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GLOSSARY 


CPU 

central processing unit 

CSC 

Computer Sciences Corporation 

FTE 

full-time equivalent 

GSFC 

Goddard Space Flight Center 

KSLOC 

source lines of code in thousands 

LOC 

lines of code 

NASA 

National Aeronautics and Space Administration 

SEL 

Software Engineering Laboratory 

SLOC 

source lines of code 

SME 

Software Management Environment 

TBD 

to be determined 
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